Hit a Wall During Upgrade? This Guide Walks You Through Upgrading DolphinScheduler from 2.0 to 3.0
Due to project requirements, we needed the data quality module, which offers excellent data quality monitoring capabilities for data warehouses. Therefore, we decided to upgrade from the existing 2.0 version to 3.0 or above. We tested both versions 3.0.1 and 3.1.1 by running identical task scheduling operations such as pausing tasks. In the end, we chose version 3.0.1.
Reasons:
When testing SQL tasks in 3.1.1, launching hundreds of SQL tasks simultaneously caused errors that prevented many tasks from running properly. After consulting the community experts, it was confirmed to be a bug in DolphinScheduler. Although this issue occasionally appears in 3.0.1 as well, it is much less frequent.
Versions above DS 3.0.1 use a newer version of the ZooKeeper dependency. The driver version is 3.8.…
( 15
min )